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NAME: Software and Systems 


BRIEF DESCRIPTION OF PORTFOLIO : 

* Enable quantifiable performance evaluation of critical 
software systems 

* Manage software environments in order to preserve vital 
mission functions 

* Comprehensively understand distributed effects in large 
software infrastructures to predict global system failures 


LIST SUB-AREAS IN PORTFOLIO: 


* Models for Composeable Dynamic Software 

* Dynamic Formal Analysis and Verification 

* Online Assessment and Repair of Failure 
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Unified Approach to Software 




* Many current problems in software can be addressed in a more rigorous unified way 
by casting the software problem as a dynamic processes that can be measured and 
online management of software into existing and future systems 
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Current Program Scope 




* Models for Composeable Dynamic Software 

- New programming languages or language constructs reduce 
errors at run-time 

- Domain-specific languages enhance capabilities for code 
generation 

* Dynamic Formal Analysis and Verification 

- Verification of system properties based on formal 
specifications 

* Online Assessment and Repair of Failure 

- Abstract models of systems and their interactions facilitate 
automated generation of code 
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Systems and Software 

Agency Interaction 



• OSTP/NITRD Coordinating Group 

- High Confidence Systems and Software (HCSS) Member 

• ASDR&E 

- Software Producibility Initiative 

• Secretary of the Air Force 

- Air Force Software and systems Overview Study 

• NSF 

- Cyber Physical Systems 

* Panelist and guest speaker at 2011 meeting 

• NASA 

- V&V of Flight Critical Systems 

- Ames Research Laboratory 

* Human Systems Integration Division 

* Intelligent Systems Division 
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Systems and Software 

Other funding agencies 



• Army Research Office 

— Software investment mostly directed toward information 
assurance 

• ONR 

— Software and Computing Systems 

• Principles for Correctness and Security Properties 
— Human Robot Interaction 
— Perception and Cognitive Control 

• NSF 

- Cyber Physical Systems - focused on interaction with phyiscal 
environment and sensing systems 

• DARPA: Software Producibility 
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Systems and Software 

Program Trends 



• Software Models Using Adaptive Feedback and X 
Complexity Reduction 

• Feedback in Formal Analysis and Verification X 

• Adaptive repair and assessment of distributed 
software infrastructures 

• Language-based approaches 

• Modeling Human-Machine Interaction 

• Agent-based approaches y 
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V Jfr Soft ware Contracts 

Felleisen, Northeastern 

Approach: Software contracts incorporate feedback into models of online 
software assessment and require analysis of data type representation and 
meaning of data types to software performance 

Payoff: Real time assessment of registers and data types in hardware 
software infrastructures can be performed 



Contracts Create Ability 
To Trace Logical Errors 


Trace of Logical Outcome of 
Mathematical Computation 



Contract With Feedback 



Contract + Feedback Allows Identification 
Of Logical Process Failure in Real Time 
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Scalable Model Checking 

C. Tinelli U Iowa, C. Barret, NYU 



Approach: Formal verification suffers from state space explosion. 

Compactly represent logical symbols in scalable nested satisfiability modulo 
theory (SMT) 


Payoff: More automated more scalable verification to handle large 
heterogeneous systems 


Compact SMT Language 

► Valid: 

► satisfied by all states in Q 

► Inductive: 

► Ks,,) 1= P(s 0 ), 

► P(a n ),T(s n ,s n+1 ) 1= P(s n+ i) 

► k-inductive: 

► l(s 0 ), T(s 0 ,s x ),T^, s k ) 1= P(s 0 ),P^), 

► T(s n , TCW- S n+k+lT P(s n ), ...,P(sJ 1= P(s n+t+1 ) 

► Invariant: 

► satisfied by all reachable states of S 


Improved Lower Dimensional 
Model 
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Adaptive Software Testing 

Myra Cohen, U Nebraska Lincoln 



Approach: Understanding how to statistically represent a software model 
for software testing requires accurate models of mapping what to measure 
to performance 

Payoff: Using a principled approach that captures the right level of software 
and abstraction statistically enables accurate statistical representation of 
failure modes 


Statistical Software Testing 
and Measurement 

Code 


Failure State 

Space Transitions Identified 















Mission Verification 

Elbaum, Dwyer U. Neb., Rosenblum, U. Col. London 



Approach: Develop a language to represent mission scenarios tied to 
integrated distributed software architecture. 

Payoff: Verify global mission properties as function of lower level 
software constructs for quantifiable fault tolerance in achieving mission 
objectives 


Mission Analysis Fault Tolerant 

Language Architecture Mission Design 

















Feedback in Software Architecture 




Smolka, Stony Brook, Havelund, JPL 



Approach: Many software systems are introduced into environments that have 
uncertain conditions that result in unforeseen failures. Feedback failure correction 
mechanisms can augment software to adapt to failures 

Payoff: Systems such as those on networks or those subject to uncertain physical 
environments can adapt to conditions using binary runtime repair of errors or faults 
based on automata theory and algebraic proofs of correctness 


Robust Architecture with Feedback 


Mathematical Formalism 



Automata Description (feedback) 

rt(i)= 

eGOU{r} t' 


Formal Logic (constraints) 

P ::= X | nil | a^ w )?t \ b( r )lt \ T( r )-t \ 

h + t 2 | *ioJM2 | t[0] | t{a^a'} \ / iX.t 


NASA Slated to Use Technology in Next Generation Mars Rover 
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W Runtime Repair 

S.JKhurshid. UT Austin 

Approach: Afunctional approach can be developed for real time software 
runtime repair using new paradigms for online verification 
Payoff: Faults in software can be corrected in real time and tracked rigorously 



Real Time Runtime 
Software Repair Architecture 



Results in Corrections of 
Multiple Faults 
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Automated Model Revision 

Kulkarni, Mich State 



Approach: Verification tends to use approaches that are fixed based on the notion 
of pre-existing code and logical structures. In order to adapt to unanticipated 
conditions it is necessary to be able to revise models if conditions change. 


Payoff: In dynamic heterogeneous systems, it is necessary to update the 
verification of the system as it evolves 


Adaptive Verification 


Identify the state predicate 
m.rUow where faults 
alone violate the safety; 

3 * := 3 a—i/nj 


No 


Identify transitions in the faulHrjtolarantprogram 
tfjlitmay 00 included in ths faulMolerant program 



Adaptive Verification 
Space 



Question : Is it possible to revise the model automatically such that it 
satisfies the failed property while preserving the other properl 
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Systems and Software 

AFRL Tech Directorate Interest/Coordination 



• Information Directorate 

- Systems and Software Producibility 

- Multi-core Computing 

• Air Vehicles 

- Flight-critical systems and software 

- Mixed-criticality architectures 

• Human Effectiveness 

- Modeling of human-machine systems 
— Meta-information portrayal STTR 

• Robust Decision Making STT 

- Large Scale Cognitive Modeling/C2WT 



DSML-s 

GME 



Multi-Paradigm 

Modeling 
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GME 

C2WT Mo< 
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Increased Scale/Integration via DSMLs Anchored in DEV 


*±P 


(Douglass, 711 th HPW/RH) 



DEVS (discrete event 
system specification) 

• Formal rigor 

• Model reusability 

• Interoperability 


A discrete event system specification (DEVS) is a 
mathematical structure (7-tuple) 

M=<X,S.YJ lru J exr A.ta> 

where 

X is the set of input values 

S is a set of states 

Y is the set of output values 

'■ S i s the internal transition function 

d ea : QxX S js the external transition function 
X-.S^Y is the output function 

ta:S -> is the time advance function 

_V\_n_ 



Plans routes 
from targets to 
targets under 
constraints 
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Focus on Object 
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Domain-Specific Languages 

• Tailored for cognitive modeling 

• Semantically anchored in DEVS 


High-Performance Computing 

• Scalable simulation infrastructure 

• Exploiting 25 years of DEV 
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SPRUCE 

Drager/RI 



Approach: Use parallel processing resources and network infrastructure as 
means of emulating and detecting system faults in new software deployment 
Payoff: Deployment of new software tools has far fewer defects and more 
detailed assessment of integrated system performance 


Software-Intensive 
Systems Producibility 
Initiative (SISPI) 


New software research ideas 



New SPRUCE approach ideas 
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Systematic transition of 
software producibility 
technologies 
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Software Collaborations at AFOSR 




* Information Operations and Security 

- Fundamental software constructs for software and system security 

* Information Fusion 

- Signal and sensor processing for integration of large data into systems architectures 

• Complex Networks 

- Mathematical and statistical methods for network and networked systems 

• Foundations of Information Systems 

- Measurement and statistical verification for software, network, and hardware 

• Computational Mathematics 

- Methods of computational modeling of large complex physical processes 

* Dynamic Data Driven Applications Systems 

- Strategies for real time feedback of data into distributed computational processes 

* Optimization and Discrete Mathematics 

- Optimization strategies and algorithms for discrete computational processes 

• Dynamics and Control 

- Dynamical systems theory for assessment of performance of control architectures 
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Transitions 




• Smolka/Havelund (Stony Brook/JPL) 

- JPL Mars Science Laboratory using rule-based specification 
language to ensure correct execution of software on next Mars 
Rover 

• Harmonia STTR with AFRL/RI 

- using a modified version of Hadoop data analysis API for 
distributed parallel load balancing and computation over cloud 
architectures 

• Tinelli/Barrett (lowa/NYU) 

- Rockwell-Collins interested in transitioning SMT-based verifier 
research into formal methods toolkits for avionics systems 

• Durfee (Univ of Michigan) 

- Collaboration on SBIR with Intelligent Automation Inc., applying 
hybrid scheduling techniques to large-scale human expert teaming 
problems involving dozens of teams, hundreds of experts, and 
thousands of constraints. 
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